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Abstract. In this paper we point out a converse result of the celebrated 
Jensen inequality for differentiable convex mappings of several variables and 
apply it to counterpart well-known analytic inequalities. Applications to Shan- 
non's and Renyi's entropy mappings are also given. 



1. Introduction 

Let f : X ~* Rhe a convex mapping defined on the linear space X and Xi e X, 
Pi > (i = 1, ...,m) with P„ := > 0- 

The following inequality is well known in the literature as Jensen's inequality 

/ 1 " \ 1 
(1-1) / h^E^''^0 7^Ep*/(^')- 

\ t—1 / i—l 

There are many well known inequalities which are particular cases of Jensen's in- 
equality such as the weighted arithmetic mean-geometric mean- harmonic mean 
inequality, the Ky Fan inequality, the Holder inequality, etc. For a comprehensive 
list of recent results on the Jensen inequality, see the book and the papers P]-|14| 
where further results are given 

In this paper, we point out a converse inequality for Jensen's result for 
the case of differentiable convex mappings whose partial derivatives are bounded. 
Applications for some particular inequalities and for the Shannon and Renyi entropy 
mappings are also given. 

2. A Converse Inequality 

The following converse of Jensen's inequality holds. 

Theorem 1. Let f : M" — > M &e a differentiable convex mapping and Xi G R", 
i = 1, TO. Suppose that there exist the vectors ipi4' ^ 1^" such that tp ^ ^ 4' (the 
order is considered on the co-ordinates) and m, M £ M" are such that m < ^•^^^'^ < 
M for all i G {1, to} . Then for all pi > {i — I, ...,m) with Pm '■— Xli=i Pi > '-'i 
we have the inequality 



(2.1) < X^pJ [x,) -f\-^ Y.P^x. I < T 11$ - <^ll \\M 

where ||-|| is the usual Euclidean norm on . 
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Proof. Firstly, and for the sake of completeness, we prove the following inequality 
for convex functions obtained by Dragomir and Goh in |14| : 

1 / 1 " \ 

(2.2) < Y^pJ (x^) ^ f [ J2p,a:A 

2—1 \ l—l / 

< -^"^P^ (a;i,V/(a;0) - ( -^"^PiXi, — "Ypz"^ f (xi) ) , 

where (•, •) is the usual inner product on M" and 

,_df{x) _ fdfix) df{x) \ 

•^^ ^~ dx ^ dx^ ax« J 

is the vector of the partial derivatives, x — [x^, a;") S R". 
As / : R" — > M is differentiable convex, we have the inequality 

(2.3) f{x)-f {y) > (V/ {y),x-y), for all x, y G R". 
Choose in ^2.\\y x = -p— J^^iPi^i ^^^'^ V ~ ^'^ obtain 



(2.4) 



for all j e {1, 7i} . 

If we multiply H2.4|l by pj > and sum over j from 1 to m, we obtain 

™ 1=1 / j=i 

^ / m m \ m 

" \j = l ^=l I ] = ! 

Dividing by Pm > 0, we obtain H2.2|l . 
A simple calculation shows that 

^"^ ^=l \ *=1 ^™ i=l / 

1 " 

Taking the modulus in both parts of (|2.5|) . and accounting for the fact that the 
left hand side is positive (by (|2.2|) '). we obtain, by Schwartz's inequality in inner 
product spaces, i.e., we recall it |(a,5)| < ||a|| ||5|| , a, 5 S R", that 

^ m / 1 ^ m \ 

i—l \ %—l i—l I 

^ m 

- Tp^ X! PiPj I ~ V/ (x,) - V/ (xj)) | 



Using the Cauchy-Buniakowsky-Schwartz inequality for double sums, we can state 
that 



(2-7) ^ E P^Pi - -^^H 11^/ (•^») - ^/ (^^Ol 
As a simple calculation shows that 

E P^Pj 11^* - ^^11' = Ep 



^ m 



2P2 



and 



— Epd|V/(:r,)f - — EW(^ 

2—1 2—1 

we can state, by (I2.6|l and (|2.7|) . that 

-j^ 771 / 771 ^ 777 



p 



i=l 



< 



-^Ep»ii^«ii'~ "^Ep^ 



■i— 1 i—l 
1 

2\ 2 



2\ 2 



-^Ep*ii^/(^oii'- 7^Ew(:r.) 

, ?— 1 %- 

Now, let us observe that, by a simple calculation 

-j^ 771 771 

(2-9) -^Ep' 11-^*11^ " "^Ep*^* 

^771 -, . I 7n T 

z— 1 z— 1 / i—l 

As < < (i € {1, m}) , then (cf) — Xi^Xi — ip) > for all i G {1, and 
then 

T77 

E^i a^^iia;^ -i>) >0 
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and, by we obtain 

^ m 

(2-10) -j^T^P^ 



^ m 



< 



It is known that if i/, z G M", then 



(2.11) 



with equahty iff z = y. 

Now, if we apply H2.11|l for the vectors z — (t>—YZ —T i P'^-- U— 'p~ J2"-Li Pi^i 
ip, we deduce 

/ 1 " 1 \ 1 

\ i=l J=l / * 

and then, by p.9|l - (|2.10() . we deduce that 



<^ll0-^ll'. 



(2.12) -5- Xl^*' 11^*11^ ^ "^Xl^'*^* 

-^"^ i=i -^"^ »=i 

Similarly, we can state that 

(2-13) ^E^^' 11^/(^^)11'- ^E^/(^^; 

Finally, by (j2!HI) and ifTT^ - lfni| . we deduce 

(2.14) E^^' (^')) " ( 7^ Ep^^*' 7^ E^''^/ 



< i||A^-m||^ 
- 4 II II 



< ||M-m||, 
which, by (|2.2|) . gives the desired inequality (|2.1|l . | 

Remark 1. A similar result for integrals can be stated, but we omit the details. 
Remark 2. The conditions 



(2.15) 



< Xi < (p, m < 



dx 



<M (i = 1, ...,to) 



can be replaced by the more general conditions 

(2.16) f2p,{^-x.„x.,-i>)>0 and Vm - ^4^, - m ) > 



i=l i=l 

and the conclusion \2.1]) will still be valid. 



dx dx 



Remark 3. Even if the new inequality \2.1]) is not as sharp as the Dragomir-Goh 
inequality yd.'^) . it may be more useful in practice when only some bounds of the 



partial derivatives ^ and of the vectors Xi {i = l,...,m) are known. Namely, it 
provides the opportunity to estimate the difference 



^ 5^ P»/ (a;.) - / ^ 51 P-^' 

2—1 \ t—1 / 



when the quantities \\(j) — tpW and \\M — m\\ are known. 

For example, if the partial derivatives ^ are bounded, i.e., there exists m,M G 
R" such that m < ^ < M on the co-ordinates, and if we choose the vector Xi 
{i~l,...,m) not "very far" from a constant vector xq, i.e., ||0 — i/'H < JW^^^' 
e > 0, then, by 1^2. we can conclude that 

0<A{f,x,p)<s. 

The case of convex mappings of a real variable can be stated as follows [2UJ . 

Corollary 1. Let / : K ^ M 6e a differentiate convex mapping and Xi €z I for all 
i G {1, m} . Then we have the inequality: 

1 ™ / 1 ™ \ 

(2.17) < J2pJ(j:,)-f[ Y.p,xA 

? — 1 \ t—1 / 

< i (Af - m) (/' (M) - /' (m)) , 

where pi > (i = 1, ...,m) and P„i :~ J2^iLiPi > 0- 

The proof is obvious by the above findings, taking into account that the mapping 
/' is monotonic nondecreasing, and then /' (m) < /' {xi) < f (M) for all i e 
{!,..., to}. 

3. Applications for Weighted Means 
Consider the classical weighted means: 

n 

An {p, x) : — 5^ piXi - the arithmetic mean, 

n 

Gn (p, x) : = x^' - the geometric mean, 

i=l 

Hn {p, x) : — — — - the harmonic mean, 

provided that Xi > (i — l,n) and pi (i = 1, n) is a probability distribution, 
i-e-, Er=iP' = 1- 

The following inequality is well-known in the literature as the arithmetic mean- 
geometric mean-harmonic mean inequality 

(3.1) An ip, x) > Gn {p, x) > Hn {p, x) , 

with equality iff xi = ... = a;„ (for > 0, i — 1, ...,n). 
The following corollaries hold. 
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Corollary 2. Let < m < < M < oo, > {i = 1, n) . Then 



(3.2) 1 < " < exp 

C^n (P, a;) 



(M - m)^ 



4mAf 

Equality holds in j5'. jj)) simultaneously iff Xi = ... = Xn. 

The proof follows by the inequality H2.17|l for / (x) — ~\nx, x > 0. 
Corollary 3. Let < m < < M < oo, pi > {i = 1, ...,n) . Then 

' {M ~mf' 



(3-3) 1 < „ -s < exp 

Hn [p, y) 



Equality holds iff yi = ... = y-n- 

Corollary 4. Let p>l and < m < Xi < M < oo, pi > {i = 1, .., n) . Then 



(3.4) 0<^p.xf- ^p,;xj < ^ (M - m) (MP-i - mP-i) 

1=1 \j=i / 

Equality holds iff xi = ... = Xn. 



The proof follows by H2.17|l for the mapping / {x) = xP , p > 1, x > 0. 
Finally, we have 



Corollary 5. Letpi,Xi be as in Corollary\^ Th 



en 



(35) I- ^(M 

- [A„{p,x)f-^^'^'> - W 
Equality holds iff xi = ... = a;„. 

The proof follows by H2.1|l for the mapping / (x) = xlnx, x > 0. 

4. Applications for Shannon's Entropy 

Let X be a random variable with the range R = {xi, x„} and the probability 
distribution pi, ...,p„ [pi > 0, i = I, ...,n) . Define the Shannon entropy mapping 

n 

H{X) ■.= -Y,pMPr- 

i=l 

The following theorem is well known in the literature and concerns the maximum 
possible value of H {X) in terms of the size of R ^1 p. 27]. 

Theorem 2. Let X be defined as above. Then 

(4.1) Q < H {X) <\-sin. 

Furthermore, H {X) = iff pi = 1 for some i and H (X) = \nn iff pi = ^ for all 
i e {1, ...,n} . 

In the recent paper 1141, Dragomir and Goh proved the following counterpart 
result. 
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Theorem 3. Let X be defined as above. Then 

(4.2) (}<\nn-HiX) < ^ {p^ - Pjf ■ 

l<i<j<n 

Equality holds simultaneously in both inequalities iff Pi = ^ for all i £ {1, ...,n} . 

We give here the following lemma which concerns an analytic inequality for the 
log —map with applications for entropy. 

Lemma 1. Let < m < < Af < oo, pi > {i — 1, ...,n) with J^^^iPi — ^■ 
Then 

\i = l / 1 = 1 

The proof follows by Corollary^ choosing f (x) = — Inx and Xi = i = 1, ...,n. 
The above lemma provides the following converse inequality for the Shannon 
entropy mapping (see also |17l p. ]): 

Theorem 4. Let X be as above and put p min^^Y^pi and P :— maXj^YTTK- 
Then we have 

(4.4) Q<\un-H{X)< ^ 



4pP 

Proof. Choose in the above lemma f j = ^ G -p, ^ and m = -p , Af = i to get the 
desired inequality H4.4|l . | 

Another analytic inequality which can be applied for the entropy mapping is 
embodied in the following lemma. 

Lemma 2. Let < m < < A/ < oo, pi > {i — 1, ...,n) with J2'i=iPi = 1- 
Then 

n n / ^ \ 

(4.5) < ^p.e.ln^.-J^Kf.ln J^K^J 

i=l 1=1 \i=l / 

< ^{M - m) (In M - In m) 

^ 1 (A-f - mf 
4 VmM 

Proof. The first inequality follows by Corollary ^ choosing / (x) — xlnx, which is 
a convex mapping on (0, oo) , and Xi = ^j, i = 1, n. 

The second inequality follows by the celebrated inequality between the geometric 
mean G {a,b) := a/o^ and the logarithmic mean 

{a if b — a 

, a, 6 > 
T^H— if b^a 
mo— In a ' 

which states that 

G{a,b) <L{a,b), a,b>0 

i.e., 

In — In a 1 

< 
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Choosing b — A/, a — m, we obtain 



1 , _ ^ „ , . , ^ 1 (Af - m) (InM - Inm) 
-(Af-TO InAf-lnm < --^^ ' 

^ (AT - mf . 



The lemma provides the foUowing converse inequaUty for the entropy mapping 

m 

Theorem 5. Let X be as in Theorem^ Then we have 



2 



(4.6) Q<\nn- H{X) < - {P - p) (In P - Inp) < 



4 ' ' ' ' - 4 ^/jJP 

Proof. Firstly, let us chose pi = - in H4.5|l to get 



(4.7) 



i=l i=l \ i=l / 



< i ( Af - m) (In M - In m) 

< — (M - mf . 

~ 4\/A/m 

Now, if in H4.7|l we assume that = pi e [p, P] , then we obtain 

< - \iin--H{X) < - [P-p) (InP -Inp) < - ■ Zl} , 
n n A 4 ypP 

from where results (14.6(1 . | 

5. Applications for Renyi's entropy 
The Renyi entropy of order a, a G (0, 1) U (1, oo) is defined by JSj 



IAX):^^1.{±P?^ 



(5.1) 

Using Jensen's inequality for convex mappings applied for / (x) = — In (x) , we have 

Cn \ 71 n 

"^PiXi > l^^i' Pi> (« = 1- ■■■,n) , Ep« ^ 1- 

i=l / i=l i=l 

If we choose Xi := (i = 1, n) in (|5.2() . we obtain 

(n \ n 

j=i / i=i 

which is equivalent to 

(5.3) {l~a)[Ho.{X)-H{X)]>0. 

Now, if a e (0, 1) , then iJ„ (X) < H (X) and if a > 1, then (X) > H (X) . 

Equality holds in 1(5. 3() iff (Pi)i=TTr ^ uniform distribution and this fact follows 
by the strict convexity of — In (•) . 
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We can now point out a counterpart result for H5.3|l . 
Theorem 6. With the above assumptions, we have 

(5.4) (1 - a) [H^ (X) H (X)] < 

provided that 0<p<pi<P<l (i ~ I, ...,n) . 

Proof. We use LemmaHfor :— p"^^ and take into account that, for a £ (0, 1) , 
we have P"^i < < p"^^, (* = 1, ■■■,n) and, for a E (l,oo) , we havep""^ < < 
(j = ...,n) . Choosing in the first case m — M = and in the 

second case m = p"~^, M — P°'^^, we obtain the same upper bound 

(M - mf _ (P"-i ^p°~i)^ 



Now, let us remark that a particular case of H4.3|l for Pi — ^ {i — ^, n) states 
that 

(5.5) < In ( e 1 - f l.ln(^,) < 



/ « \ n 
\ i=l / 1=1 



provided that < m < < Af < oo {i — 1, n) . 

This inequality allows us to prove the following inequality for the Renyi entropy: 

Theorem 7. With the assumptions of Theorem\^ we have the inequality 

(5.6) < (l-a)i?„(X)-lnn-alnG„(p) 

n {P°'-p°'f 

- 4 ■ papa 

where G„ (p) is the geometric mean of pi {i — 1, ...,n) , i.e., we recall that Gn {p) — 

Proof. We choose in the inequality l|5.8|l — npf {i = 1, ...,n) and observe that 
np"' < < nP", so we can have m — np°' and M — nP°' in 1)5.5(1 . getting the 
desired inequality. | 

If we assume that a e (0,1) and apply Corollary ^ for the convex mapping 
/ (a;) — —x", we deduce the following inequality 

/ n \ " n 

(5.7) < Ep'^« - E^''^? < f (M - m) (m"-i - M""!) , 

\i=l / i=l 

provided that < m < Xi < M < oo, pi > [i = 1, rt) and X]"=i ~ 
If in 1(5. 7|l we put Pi = (* = Ij ^) j then we obtain 



1 / " V 1 " 
o<;^ E-0 --E^ 

\i=l / i=l 



(5-8) 0<;i,(E-0 -;E^"^f (^^^--)K-^-M"-i). 



The following inequality for the a-Renyi entropy holds. 
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Theorem 8. If < p < pi < P < 1 {i — 1, ...,n) and a G (0, 1) , then we have the 
inequality 

(5.9) < n^-" - cxp [(1 - a) {X)] <jn{P- p) (p^-^ - P^-^) . 

Proof. Choosing Xi ^ Pi {i ~ 1, ...,n) in (|5.8(l . we deduce 
1 1 " 

(5.10) < — - - J^p^ < f (P - p) (K-i - P"-i) . 

i=l 

Taking into account that X]"=i-Pf — exp [(1 — a) iJo, (X)] , then from H5.1U|I we 
deduce the desired incquahty H5.9|l . | 

Now, if we define by E (X) := J2^=iPh the informational energy of the random 
variable X, then we may also point out the following inequality. 

Theorem 9. If Pi and a are as in Theorem\^ then we have the inequality 

(5.11) Q<E" (X) ~ exp [~aH^+i {X)] < | (P - p) - P"-i) . 

The proof follows by the inequality H5.7|l . choosing Xi — Pi, i — 1, n, and we 
omit the details. 

Now assume that a G (1, oo) . Then, applying CoroUary^for the convex mapping 
/ (x) = x" , we deduce the following inequality 

n / n \ « 

(5.12) 0<^p,xr- K]p,a;, < | (M - m) (m^^i - M"-i) , 

i=\ \i=l / 

provided that 0<m<a;i<M<(X), Pi>0(z = l,...,rt) and ^Y^=\ Pi = 1- 

Finally, using a similar argument to the one above, we can state the following 
theorem. 

Theorem 10. Let a E (1, oo) and < p < pi < P < 1 {i — 1, ...,n) . Then we have 
the inequalities 

< exp [-aH^ {X)] - {X) < | (P - p) (P^-^ - p^-^) 

and 

< exp [(1 - a) (X)] - n^-" < |n (P - p) (P"-i - p"-i) . 
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